Skip to content

Deduplicate metadata in Prometheus Remote Write 2.0 requests - #7760

Merged
SungJin1212 merged 2 commits into
masterfrom
dedup-rw2-metadata
Aug 18, 2026
Merged

Deduplicate metadata in Prometheus Remote Write 2.0 requests#7760
SungJin1212 merged 2 commits into
masterfrom
dedup-rw2-metadata

Conversation

@SungJin1212

Copy link
Copy Markdown
Member

What this PR does:
Deduplicate metric metadata when converting Prometheus Remote Write 2.0 requests. PRW 2.0 attaches metadata to every series, so a metric family was previously expanded into one MetricMetadata per series.
Because metadata counts towards the ingestion rate limit, tenants using remote write 2.0 consumed roughly twice their configured -distributor.ingestion-rate-limit for the same data.

Which issue(s) this PR fixes:
Fixes #

Checklist

  • Tests updated
  • Documentation added
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]
  • docs/configuration/v1-guarantees.md updated if this PR introduces experimental flags

Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>
@SungJin1212 SungJin1212 changed the title Deduplicate metric metadata in Prometheus Remote Write 2.0 requests Deduplicate metadata in Prometheus Remote Write 2.0 requests Aug 13, 2026

@friedrichg friedrichg left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, only a nit in the Changelog

Comment thread CHANGELOG.md Outdated
* [ENHANCEMENT] Compactor: Reduce object storage GET calls when updating the bucket index by skipping re-reading parquet converter markers for blocks that already have a valid-version parquet entry in the previous index. #7669
* [ENHANCEMENT] Upgrade Thanos and promql-engine to latest. #7740
* [ENHANCEMENT] Ruler: Adjust ruler frontend decoder to not wrap query error messages with execution prefix, this makes error responses consistent between internal and external ruler paths. #7741
* [ENHANCEMENT] Distributor: Deduplicate metric metadata when converting Prometheus Remote Write 2.0 requests. PRW 2.0 attaches metadata to every series, so a metric family was previously expanded into one `MetricMetadata` per series. #7759

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* [ENHANCEMENT] Distributor: Deduplicate metric metadata when converting Prometheus Remote Write 2.0 requests. PRW 2.0 attaches metadata to every series, so a metric family was previously expanded into one `MetricMetadata` per series. #7759
* [ENHANCEMENT] Distributor: Deduplicate metric metadata when converting Prometheus Remote Write 2.0 requests. PRW 2.0 attaches metadata to every series, so a metric family was previously expanded into one `MetricMetadata` per series. #7760

@dosubot dosubot Bot added the lgtm This PR has been approved by a maintainer label Aug 18, 2026
Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>
@SungJin1212
SungJin1212 merged commit a330338 into master Aug 18, 2026
40 checks passed
@SungJin1212
SungJin1212 deleted the dedup-rw2-metadata branch August 18, 2026 10:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

component/distributor lgtm This PR has been approved by a maintainer size/L type/feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants